Section: Scientific Foundations

Registration

Image registration consists in finding a geometrical transformation in order to match n sets of images. Our objective is to work both, on rigid registration methods in order to develop new similarity measures for new imaging modalities, and on deformable registration to address the problem of tissue dissipation.

The registration between two images can be summarized by the expression  [59] :

where ${\Omega }_s$ and ${\Omega }_t$ are respectively the two homologous sets of features respectively extracted from the source and the target images. These sets represent the two images in the registration process. They can be very different in nature, and can be deduced from a segmentation process (points, contours, crest lines ...) or directly from the image intensities (e.g. the joint histogram). ${\Phi }_{\theta }$ is the transformation, ($\theta$$\in \Theta$ being the set of parameters for this transformation), $\Delta$ is the cost (or similarity) function, and $\Psi$ is the optimization method. {$\Omega ,\Phi ,\Delta ,\Psi$} are the four major decisive factors in a registration procedure, the set $\Theta$ being a priori defined. In addition to new evolutions of these factors, a constant concern is to propose a methodology for validating this registration procedure. We already have been largely involved in these aspects in the past and will maintain this effort  [64] , [69] , [66] , [67] , [63] .

In the domain of rigid registration, our research is more focused on new problems coming from the applications. For instance, the mono and multimodal registration of ultrasound images is still an open problem. In this context we are working in looking at new similarity measures to better take into account the nature of the echographic signal. Similarly, in the interventional theatre, new matching procedures are required between for instance video, optical or biological images and the pre-operative images (CT, MRI, SPECT/PET, Angiography ...). Some of these problems can be very challenging. For a number of new applications, there are no existing solutions to solve these problems (e.g. fusion of biological images with interventional images and images coming from the planning).

In many contexts, a rigid transformation cannot account for the underlying phenomena. This is for instance true when observing evolving biological and physiological phenomena. Therefore, deformable registration methods (also called non-rigid registration) are needed  [65] . In this domain, we are working in the following three directions:

• Non-rigid registration algorithms benefit from the incorporation of statistical priors. These statistical priors can be expressed locally (for instance through a statistical analysis of segmented shapes) or globally (by learning statistics about deformation fields directly). Statistical priors (local and global) are useful to capture probable or relevant deformations.

• Non-rigid registration methods can be broadly sorted in two classes: geometric methods that rely on the extraction and matching of sparse anatomical structures and photometric methods that rely on image intensities directly. These two kinds of methods have their advantages and drawbacks. We are working on further cooperative approaches where information of different nature (global, hybrid and local) could be mixed in an elegant mathematical way.

• Finally, our research is focused on a better modeling of the problems, mainly in two directions: firstly the relationship between the observed data (image intensities) and the variables (registration field) should be better understood. This leads to more adapted similarity measures in specific application contexts (for instance when registering ultrasound images or registering two textured reconstructed surfaces from stereovision  [68] ). Secondly, specific modeling of the deformation field is useful in specific contexts (for instance when matter is disappearing, fluid mechanics models will be more adapted than classical regularized deformation fields).